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images  to  demonstrate  flat-bottom-hole  and  crack  detection  in  experimental  data  and  planar  defect  detection  at  very  low 
signal-to-noise  ratio  using  simulated  data.  ROC  analysis  compares  the  new  correlation  method  and  the  classical  method. 
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ABSTRACT-  In  ultrasonics,  image  formation  and  detection  are  getterally  based  on  signal  amplitude*  In 
this  paper,  we  describe  an  amplitude  independent  approach  for  imaging  and  detection  based  on  the 
similarity  of  adjacent  signals,  quantified  by  the  correlation  coefficient  calculated  between  A-scan$. 
Correlation  coefficient  images  are  introduced  and  shown  with  C-scan  images  to  demonstrate  flat-bottom- 
hole  and  crack  detection  in  experimental  data  and  planar  defect  detection  at  very  low  signal-to-noise  ratio 
using  simulated  data.  ROC  analysis  compares  the  new  correlation  method  and  the  classical  method. 


Keywords,  ultrasonics,  signal  processing,  correlation,  crack  detection,  weld  inspection,  flaw  detection 
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INTRODUCTION 

The  most  common  method  of  flaw  detection  in  ultrasonic  nondestructive  evaluation 
is  based  on  C-scan  images*  One  weakness  of  this  peak-amplitude  dependent  method  its 
sensitivity  to  background  noise,  especially  at  low  signal-to-noise  ratio  (SNR)  where  false¬ 
positive  and  false-negative  detection  rates  may  be  unacceptably  high.  In  this  paper  we 
present  a  complimentary  approach  that  relies  on  the  similarity  between  adjacent  A-scans 
with  the  assumption  that  flaw  signals  change  shape  less  quickly  as  the  transducer  changes 
position  than  do  noise  signals*  The  amount  of  shape  change  present  is  quantified  by  the 
correlation  between  adjacent  windowed  A-scans,  [1-3] 

This  paper  will  discuss  the  issues  involved  with  correlation  imaging  and  provide 
example  correlation  images  for  both  measured  and  simulated  data.  Computer  generation  of 
noise  and  statistical  performance  analysis  are  also  addressed. 

DATA 


Ultrasonic  data  was  collected  in  immersion  mode  from  three  samples.  The  first 
sample  was  a  stainless  steel  plate.  A  Panametrics  10  MHz,  ^2”  diameter,  4”  focal  length 
transducer  at  normal  incidence  was  used  to  collect  grain  noise  signals  over  a  regular  45  x 
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62  grid  with  0.5  mm  between  measurement  positions.  This  data  was  used  for  showing 
example  noise  correlation  images  and  its  statistical  properties  were  used  for  the  creation  of 
simulated  noise.  The  second  sample  was  a  stainless  steel  annular  ring  with  an  inside 
diameter  of  40  ram  and  an  outside  diameter  of  70  mm  which  was  machined  to  add  five 
equal  depth  fiat  bottomed  holes.  This  sample  was  scanned  at  normal  incidence  with  a 
Panametrics  15  MHz,  V”  diameter,  6”  focal  length  transducer  over  a  polar  grid  with  2° 
between  radial  scan  lines  and  0.762  mm  between  circumferential  scan  lines.  The  third 
sample  was  comprised  of  two  aluminum  plates  fastened  together,  EDM  notches  were 
machined  between  select  fastener  locations.  Oblique  incidence  pitch-catch  measurements 
were  made  using  two  Panametrics  1 0  MHz  ‘/a”  transducers  (one  focused  and  one  planar) 
arranged  5^  from  normal.  Data  from  these  two  samples  was  used  to  demonstrate  the 
correlations  analysis  forvari^s  flaw  fypes’andlor  both  polar  and  Cartesian  scans. 

Data  was  also  simulated  to  provide  a  means  of  controlling  SKR.  and  defect  region 
size.  This  data,  x,  was  created  by  adding  a  simulated  defect  signal,  represented  as  a 
Gaussian  damped  sinusoid,  y,  scaled  by  B,  to  simulated  grain  noise,  n,  at  each  ij  position. 

=  n{ij,t)+  5(r,  (1) 

The  defect  mask  matrix  B(iJ)  can  be  spatially  varied  to  create  flaws  with  varied  size, 
positioning,  and  SNR.  A  defect  mask  image  is  shovra  in  the  results  section. 

Simulated  grain  noise  signals  were  generated  to  match  both  the  maximum  extreme 
value  (gated  peak  value)  distribution  and  the  correlation  coefficient  distribution  obtained 
from  the  measured  grain  noise.  [4]  The  simulation  procedure  is  beyond  the  scope  of  this 
paper,  but  the  basic  process  involves  creating  each  A-scan  as  a  weighted  sum  of  the 
adjacent  A-scans  and  a  random  component  with  the  weights  chosen  to  create  the  desired 
correlation  between  the  new  and  adjacent  signals. 

THE  CORRELATION  APPROACH 

Calculations 


The  statistic  of  interest  is  the  spatial  cross-correlation  coefficient  calculated 
between  two  A-scans  adjacent  in  position.  Consider  wi  N  x  M  scan  with  each  A-scan  T 
points  long  where  the  matrix  x  =  jc(/,  j,i)  i  =  1..  JV  j  =  \  ...M  t  =  - 1  holds  the  data. 

Calculation  of  the  correlation  between  A-scans  is  then  given  by  the  following  equation 
where  p  =  is  a  sample  estimate  of  the  associated  expected  value:  [5] 


P  = 


Z  [^0'’  O'.  7)1^0  +  4.  y  +  -  '«x0  +  4.y  +  )] 

_ 


(2) 


Z  ^0. y. f  -  m^(i, y)F  Z I-^O + 4.y + 0 + 4. y + )F 

t=t,. 


where  t  is  a  discrete  temporal  index.  Subtraction  of  the  mean  (m^^  and  my)  of  each  signal 

along  with  the  normalization  removes  the  scale  dependence  and  restricts  p  to  the  range  -1 
to  1.  Row  correlations  and  column  correlations  can  be  calculated  with  =1,  =0  and 

=0,  =  1 ,  respectively.  In  Eq.  (2),  the  summation  range  in  the  time  domain  defines 
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FIGURE  1.  (a)  Measureraent  positions  are  represented  by  open  circles,  row  correlations  by  ‘R%  and  column 
correlations  by  ‘C’,  and  blank  positions  by  closed  circles,  (b)  By  considering  each  correlation  as  a  diamond 
shaped  element,  a  highly  discretized  matrix  can  be  used  for  imaging. 

the  portion  of  the  signal  (the  time  window)  of  interest,  r  controls  the  temporal  shift 
between  signals,  and  ^  is  a  spatial  shift  parameter  (<?  =  !  for  adjacent  measurement 
positions).  For  all  calculations,  t  was  set  to  zero,  assuming  perfect  alignment  of  defect 
signals;  however,  r  can  be  varied  in  Eq.  (2)  to  achieve  signal  alignment. 

Imaging 

The  issue  of  imaging  row  and  column  correlation  coefficients  is  not  simple, 
primarily  because  there  are  approximately  twice  as  many  correlation  coefficients  as 
measurement  positions.  For  an  A'' jc  M  matrix,  there  are  A'^(M  -l)  row  correlations  and 
{N  - i)M  column  correlations,  resulting  in  2NM  -M  -N  total  correlations.  Figure  1 
shows  a  schematic  representation  of  a  4  x  4  scan  (left  figure)  with  open  circles  at  the  16 
measurement  positions.  The  R’s  and  C’s  are  used  to  represent  the  positions  conceptually 
assigned  to  row  and  coluiim  correlations,  respectively.  A  polar  scan  can  be  treated  in 
similar  fashion  with  the  R’s  and  C’s  representing  the  positions  assigned  to  radial  and 
circumferential  correlations,  respectively.  For  the  4x4  example,  to  maintain  spatial 
registration,  the  24  correlations  coefficients  can  be  written  into  a  7  x  7  matrix  (see  Fig.  1), 
leaving  25  blank  elements.  These  blank  elements  spatially  correspond  to  positions  of  the 
open  and  solid  circles  in  the  schematic.  The  easiest  image  formation  approach  is  to  make 
separate  row  and  column  correlation  images.  Another  imaging  solution  is  to  assign  each 
blank  element  an  average  of  nearest  neighbor  values.  An  alternative  approach  which 
avoids  smoothing  is  to  shift  the  column  correlations  up  one  row.  This  approach 
compromises  spatial  registration;  however,  the  resultant  images  are  useful  for  qualitative 
evaluation.  A  final  approach  which  preserves  spatial  registration  is  to  consider  each 
correlation  value  as  being  centered  in  a  diamond-shape  region  (see  Fig.  1).  This  approach 
can  be  applied  to  both  Cartesian  and  polar  scan  data.  To  facilitate  display  of  the  diamond 
regions,  a  matrix  with  a  much  higher  number  of  elements  than  the  original  correlation 
matrix  is  used  to  approximate  the  diamond-shaped  regions,  that  is,  the  diamonds  are 
discretized  (see  the  right  schematic  in  Fig.  1).  Each  element  in  the  high  density  matrix  is 
assigned  a  value  based  on  which  diamond  that  element  falls  within.  The  pixels  outside  of 
the  diamond-filled  regions  are  set  to  a  single  (arbitrary)  value.  Figure  2  shows  example 
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FIGURE  2.  Correlation  images  using  high  discretization;  (a)  Cartesian  scan  and  (b)  polar  scan. 

images  created  with  this  method  using  data  taken  in  both  Cartesian  (left  image)  and  polar 
(right  image)  scans, 

SIGNAL  PROCESSING  AND  STATISTICAL  ANALYSIS 

Additional  methods  were  used  in  the  implementation  and  evaluation  of  the 
correlation  approach.  Thresholding  was  applied  to  provide  a  statistical  basis  for  detection. 
Measurements  made  in  a  region  knovm  to  be  defect- free  can  be  used  to  establish  a 
distribution  of  correlation  coefficients  for  grain  noise.  A  detection  threshold  can  then  be 
chosen  to  control  the  false-positive  rate  based  on  the  grain  noise  correlation  coefficient 
distribution.  A  square  moving-average  window  is  used  to  reduce  the  variance  in  the  grain 
noise  correlation  distribution.  Averaging  results  in  less  overlap  between  the  tails  of  the 
noise  correlation  distribution  and  the  flaw  correlation  distribution  (generally  unknown), 
making  defects  easier  to  differentiate  from  noise.  Square  averaging  windows  were  used  in 
this  work,  but  the  shape  of  the  averaging  window  can  also  be  changed  to  detect  differently 
shaped  flaws.  In  order  to  improve  detection  over  a  range  of  defect  size,  ten  averaging 
windows  were  applied  to  each  image  with  the  window  size  ranging  from  1x1  to  10x10. 
For  each  averaging  window  size,  thresholding  was  applied  with  a  value  of  1  was  assigned 
to  the  corresponding  threshold  matrix  if  the  threshold  was  exceeded  and  a  value  of  0  was 
assigned  if  the  threshold  was  not  exceeded.  The  10  threshold  matrices  where  then 
essentially  added  to  create  the  final  threshold  image  with  pixel  values  ranging  from  0  to  10. 
A  value  of  0  indicates  no  detection  hits  while  a  10  indicates  detection  for  all  averaging 
window  sizes.  An  analogous  approach  was  used  to  create  C-scan  based  threshold  images. 

Receiver  operating  characteristic  (ROC)  analysis  can  be  used  to  quantify  the 
separation  between  two  distributions.  Specifically,  an  ROC  curve  shows  the  true  positive 
fraction  (TPF)  versus  the  false  positive  fraction  (FPF)  as  the  threshold  is  systematically 
varied.  ROC  curves  can  be  calculated  for  correlation  analysis  and  C-scan  analysis  under 
varying  analysis  conditions  (SNR,  averaging  window  size,  etc.).  The  area  under  the  ROC 
curve  can  be  used  as  a  basis  for  performance  comparison  across  detection  techniques  and 
across  analysis  conditions.  For  very  high  SNR  when  the  distributions  are  completely 
separated  (Fig.  3(a)),  the  ROC  curve  is  ideal  (Fig.  3(b)),  and  the  area  under  the  ROC  curve 
is  unity.  At  lower  SNR  when  the  distributions  overlap  (Fig.  3(c)),  the  ROC  curve  (Fig. 
3(d))  reflects  the  tradeoff  between  TPF  and  FPF  (false-detection),  and  the  area  under  the 
curve  is  less  than  one.  Initial  ROC  analysis  results  are  shown  in  the  next  section. 
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FIGURE  3.  ROC  curves  (right)  from  two  different  sets  of  distribu  tions  (left). 
RESULTS 


Results  for  the  annular  stainless  steel  ring  are  shown  in  Figure  4  with  the  C-scan 
image  on  the  left  and  the  correlation  image  on  the  right.  High  values  in  the  innermost  and 
outermost  diameters  are  due  to  multiple  reflected  signals  from  features  not  in  the  plane  of 
the  defects  and  can  be  ignored.  Starting  from  the  top  and  moving  clockwise,  there  are  three 
1/16”,  one  2/16”,  and  one  3/16”  flat-bottom  holes.  In  both  images,  all  holes  are  visible; 
however,  for  the  smaller  holes  the  contrast  between  the  flat-bottom-hole  region  and  the 
background  noise  is  greater  for  the  correlation  image. 

Figure  5  shows  the  results  for  the  almiiinum  sample.  The  sample  was  scanned  in 
pitch-catch  mode  and  consists  of  two  aluminum  plates  fastened  together  as  depicted  in  Fig. 
5(a).  EDM  notches  were  machined  between  the  fasteners  as  shown  in  Fig.  5(b).  Because 
the  sample  was  scanned  in  pitch-catch,  the  presence  of  a  fastener  or  notch  results  in  a  loss 
of  signal  peak-amplitude  in  the  C-scan  image  (Fig.  5(c))  and  low  correlation  values  in  the 
correlation  image  (Fig.  5(d)).  The  three  longer  notches  are  easily  detected  in  both  images. 
This  example  demonstrates  defect  detection  based  on  a  reduction  in  correlation  relative  to  a 
defect-free  region. 
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FIGURE  4.  Images  of  annular  stainless  steel  ring;  (a)  C-scan  and  (b)  conelation. 
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FIGURE  S.  Scan  of  aluminum  sample;  (a)  set-up,  (b)  flaws  locations  (c)  C-scan,  and  (d)  correlation  image. 

Figure  6  shows  the  results  for  a  set  of  simulated  data.  Five  flaws  were  created  using 
the  defect  mask  shown  in  the  figure  with  SNRs  in  the  range  of  0.28-0.90.  The  C-scan 
image  and  C-scan  threshold  image  allow  detection  of  4  of  the  defects.  Tire  correlation 
image  reveals  the  same  four  flaws  as  well  as  a  hint  of  the  very  low  SNR  flaw  in  the  mid- 
upper  right  of  the  image.  The  correlation  threshold  image  identifies  all  five  defects.  In  this 
very  low  SNR  simulation  example,  the  correlation  approach  performs  better  than  the 
classical  C-scan  approach  in  terms  of  both  detection  and  sizing  of  defects. 

Comparison  of  the  performance  of  the  correlation  approach  with  classical  C-scan 
and  matched  filter  approaches  is  ongoing.  In  this  section,  we  show  only  initial  results 
comparing  the  correlation  and  C-scan  approaches.  Figure  7(a)  shows  the  area  under  the 
ROC  curve  (SNR  =  0.6)  for  both  approaches  plotted  versus  the  measurement  spacing 
between  adjacent  A-scans.  For  the  C-scan  approach,  the  area  under  the  ROC  curve 
remains  relatively  stable  as  the  measurement  spacing  changes.  For  the  correlation 
approach,  as  the  measurement  spacing  increases,  the  mean  of  the  noise  correlation 
coefficient  distribution  tends  toward  zero,  the  defect  correlation  distribution  shows  minimal 
change,  and  correlation-based  detection  becomes  more  effective.  Clearly,  for  the 
correlation  approach  to  work,  defect  signals  must  be  present  at  multiple  measurement 
positions.  For  defects  with  relatively  large  lateral  extent  and  low  SNTl,  these  results 
suggest  that  increasing  the  measurement  spacing  will  increase  the  efficacy  of  the 
correlation  approach.'  Figure  7(b)  shows  ROC  area  versus  SNR.  For  both  approaches, 
performance  is  better  at  a  higher  SNR.  However,  at  a  low  SNR  the  correlation  approach 
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FIGURE  6.  Example  simulation  results. 
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FIGURE  7.  Area  under  the  ROC  curve  for  varying  measurement  spacing  and  SNR. 

is  slightly  more  effective  than  the  classical  C-scan  approach.  Additional  ROC  analysis  is 
underway  to  consider  the  influence  of  averaging  window  size,  defects  signal  distortion,  and 
defect  size  on  detection  performance. 

SUMMARY  AND  DISCUSSION 

The  results  presented  in  this  paper  show  that  the  correlation  approach  is  a  viable 
defect  detection  approach.  Correlation  images  are  easily  generated  and  interpreted  since 
they  are  based  on  the  same  A-scans  used  to  generate  C-scan  images  and  have  the  same 
basic  appearance  as  C-scan  images.  The  correlation  approach  is  an  attractive  scale- 
independent  compliment  to  the  peak-amplitude  based  C-scan  approach  and  is  potentially 
more  robust  at  low  SNR  due  to  its  reliance  on  signal  shape  rather  than  a  single  peak  value. 

Further  development  of  the  correlation  approach  is  underway.  Additional  ROC 
analysis  is  being  done  to  further  guide  decisions  related  to  implementation  of  the 
correlation  approach  and  to  compare  the  correlation  approach  to  matched  filtering  for 
different  levels  of  defect  signal  distortion.  More  in-depth  study  will  also  be  done  to  assess 
the  influence  of  the  material  sample  and  measurement  system  on  the  correlation  approach. 
Finally,  more  sophisticated  detection  schemes  will  be  applied  to  both  C-scan  and 
correlation  images  to  aid  in  the  detection  of  low  SNR  defect  signals. 
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